[INFO] cloning repository https://github.com/rockerBOO/sd-tokenizer
[INFO] running `Command { std: "git" "-c" "credential.helper=" "-c" "credential.helper=/workspace/cargo-home/bin/git-credential-null" "clone" "--bare" "https://github.com/rockerBOO/sd-tokenizer" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FrockerBOO%2Fsd-tokenizer", kill_on_drop: false }`
[INFO] [stderr] Cloning into bare repository '/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FrockerBOO%2Fsd-tokenizer'...
[INFO] running `Command { std: "git" "rev-parse" "HEAD", kill_on_drop: false }`
[INFO] [stdout] 6329b158234a65915f8a985fc8d7bd69f03a5dee
[INFO] testing rockerBOO/sd-tokenizer against master#1f7f8ea0721a3b1eb73e6c6d25cccb371434b320 for pr-154065-1
[INFO] running `Command { std: "git" "clone" "/workspace/cache/git-repos/https%3A%2F%2Fgithub.com%2FrockerBOO%2Fsd-tokenizer" "/workspace/builds/worker-5-tc1/source", kill_on_drop: false }`
[INFO] [stderr] Cloning into '/workspace/builds/worker-5-tc1/source'...
[INFO] [stderr] done.
[INFO] started tweaking git repo https://github.com/rockerBOO/sd-tokenizer
[INFO] finished tweaking git repo https://github.com/rockerBOO/sd-tokenizer
[INFO] tweaked toml for git repo https://github.com/rockerBOO/sd-tokenizer written to /workspace/builds/worker-5-tc1/source/Cargo.toml
[INFO] validating manifest of git repo https://github.com/rockerBOO/sd-tokenizer on toolchain 1f7f8ea0721a3b1eb73e6c6d25cccb371434b320
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1f7f8ea0721a3b1eb73e6c6d25cccb371434b320" "metadata" "--manifest-path" "Cargo.toml" "--no-deps", kill_on_drop: false }`
[INFO] crate git repo https://github.com/rockerBOO/sd-tokenizer already has a lockfile, it will not be regenerated
[INFO] running `Command { std: CARGO_HOME="/workspace/cargo-home" RUSTUP_HOME="/workspace/rustup-home" "/workspace/cargo-home/bin/cargo" "+1f7f8ea0721a3b1eb73e6c6d25cccb371434b320" "fetch" "--manifest-path" "Cargo.toml", kill_on_drop: false }`
[INFO] [stderr]  Downloading crates ...
[INFO] [stderr]   Downloaded minicov v0.3.7
[INFO] [stderr]   Downloaded wasm-bindgen-test-macro v0.3.50
[INFO] [stderr]   Downloaded wasm-bindgen-test v0.3.50
[INFO] [stderr]   Downloaded monostate-impl v0.1.14
[INFO] [stderr]   Downloaded monostate v0.1.14
[INFO] [stderr]   Downloaded dary_heap v0.3.7
[INFO] [stderr]   Downloaded tokenizers v0.22.2
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+1f7f8ea0721a3b1eb73e6c6d25cccb371434b320" "metadata" "--no-deps" "--format-version=1", kill_on_drop: false }`
[INFO] [stdout] 283820ace6dcd88c3d1d97ebf9da94ec5d96e195c837a3644584d9457970d4ea
[INFO] running `Command { std: "docker" "start" "-a" "283820ace6dcd88c3d1d97ebf9da94ec5d96e195c837a3644584d9457970d4ea", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "inspect" "283820ace6dcd88c3d1d97ebf9da94ec5d96e195c837a3644584d9457970d4ea", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "283820ace6dcd88c3d1d97ebf9da94ec5d96e195c837a3644584d9457970d4ea", kill_on_drop: false }`
[INFO] [stdout] 283820ace6dcd88c3d1d97ebf9da94ec5d96e195c837a3644584d9457970d4ea
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+1f7f8ea0721a3b1eb73e6c6d25cccb371434b320" "build" "--frozen" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] e26e457dcd74d11c0028a41fa8f2a4d4fccfdb8d7d1e310fa81ed6a5e09cf5e7
[INFO] running `Command { std: "docker" "start" "-a" "e26e457dcd74d11c0028a41fa8f2a4d4fccfdb8d7d1e310fa81ed6a5e09cf5e7", kill_on_drop: false }`
[INFO] [stderr]    Compiling cfg-if v1.0.1
[INFO] [stderr]    Compiling wasm-bindgen-shared v0.2.100
[INFO] [stderr]    Compiling memchr v2.7.5
[INFO] [stderr]    Compiling libc v0.2.174
[INFO] [stderr]    Compiling rustversion v1.0.21
[INFO] [stderr]    Compiling getrandom v0.3.3
[INFO] [stderr]    Compiling log v0.4.27
[INFO] [stderr]    Compiling bumpalo v3.19.0
[INFO] [stderr]    Compiling rayon-core v1.12.1
[INFO] [stderr]    Compiling wasm-bindgen v0.2.100
[INFO] [stderr]    Compiling ahash v0.8.12
[INFO] [stderr]    Compiling syn v2.0.104
[INFO] [stderr]    Compiling esaxx-rs v0.1.10
[INFO] [stderr]    Compiling serde_json v1.0.142
[INFO] [stderr]    Compiling thiserror v2.0.12
[INFO] [stderr]    Compiling bit-vec v0.8.0
[INFO] [stderr]    Compiling smallvec v1.15.1
[INFO] [stderr]    Compiling macro_rules_attribute-proc_macro v0.2.2
[INFO] [stderr]    Compiling bit-set v0.8.0
[INFO] [stderr]    Compiling unicode-normalization-alignments v0.1.12
[INFO] [stderr]    Compiling macro_rules_attribute v0.2.2
[INFO] [stderr]    Compiling castaway v0.2.4
[INFO] [stderr]    Compiling rayon v1.10.0
[INFO] [stderr]    Compiling aho-corasick v1.1.3
[INFO] [stderr]    Compiling nom v7.1.3
[INFO] [stderr]    Compiling rand_core v0.9.3
[INFO] [stderr]    Compiling rand_chacha v0.9.0
[INFO] [stderr]    Compiling rand v0.9.2
[INFO] [stderr]    Compiling regex-automata v0.4.9
[INFO] [stderr]    Compiling rayon-cond v0.4.0
[INFO] [stderr]    Compiling darling_core v0.20.11
[INFO] [stderr]    Compiling wasm-bindgen-backend v0.2.100
[INFO] [stderr]    Compiling regex v1.11.1
[INFO] [stderr]    Compiling fancy-regex v0.14.0
[INFO] [stderr]    Compiling serde_derive v1.0.219
[INFO] [stderr]    Compiling monostate-impl v0.1.14
[INFO] [stderr]    Compiling thiserror-impl v2.0.12
[INFO] [stderr]    Compiling darling_macro v0.20.11
[INFO] [stderr]    Compiling darling v0.20.11
[INFO] [stderr]    Compiling derive_builder_core v0.20.2
[INFO] [stderr]    Compiling wasm-bindgen-macro-support v0.2.100
[INFO] [stderr]    Compiling wasm-bindgen-macro v0.2.100
[INFO] [stderr]    Compiling derive_builder_macro v0.20.2
[INFO] [stderr]    Compiling derive_builder v0.20.2
[INFO] [stderr]    Compiling serde v1.0.219
[INFO] [stderr]    Compiling js-sys v0.3.77
[INFO] [stderr]    Compiling dary_heap v0.3.7
[INFO] [stderr]    Compiling monostate v0.1.14
[INFO] [stderr]    Compiling compact_str v0.9.0
[INFO] [stderr]    Compiling spm_precompiled v0.1.4
[INFO] [stderr]    Compiling web-sys v0.3.77
[INFO] [stderr]    Compiling tokenizers v0.22.2
[INFO] [stderr]    Compiling sd-tokenizer v0.1.0 (/opt/rustwide/workdir)
[INFO] [stderr]     Finished `dev` profile [unoptimized + debuginfo] target(s) in 37.37s
[INFO] running `Command { std: "docker" "inspect" "e26e457dcd74d11c0028a41fa8f2a4d4fccfdb8d7d1e310fa81ed6a5e09cf5e7", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "e26e457dcd74d11c0028a41fa8f2a4d4fccfdb8d7d1e310fa81ed6a5e09cf5e7", kill_on_drop: false }`
[INFO] [stdout] e26e457dcd74d11c0028a41fa8f2a4d4fccfdb8d7d1e310fa81ed6a5e09cf5e7
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+1f7f8ea0721a3b1eb73e6c6d25cccb371434b320" "test" "--frozen" "--no-run" "--message-format=json", kill_on_drop: false }`
[INFO] [stdout] ec15a5579d70fa442d7fb207af92f0540d7a64666ab5ef2e28c6fcc06f50d130
[INFO] running `Command { std: "docker" "start" "-a" "ec15a5579d70fa442d7fb207af92f0540d7a64666ab5ef2e28c6fcc06f50d130", kill_on_drop: false }`
[INFO] [stderr]    Compiling wasm-bindgen-test-macro v0.3.50
[INFO] [stderr]    Compiling wasm-bindgen-futures v0.4.50
[INFO] [stderr]    Compiling wasm-bindgen-test v0.3.50
[INFO] [stderr]    Compiling sd-tokenizer v0.1.0 (/opt/rustwide/workdir)
[INFO] [stdout] warning: function `create_wasm_test_tokenizer` is never used
[INFO] [stdout]    --> src/lib.rs:159:8
[INFO] [stdout]     |
[INFO] [stdout] 159 |     fn create_wasm_test_tokenizer() -> SDTokenizer {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout]     |
[INFO] [stdout]     = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: function `test_wasm_tokenizer_creation` is never used
[INFO] [stdout]    --> src/lib.rs:187:8
[INFO] [stdout]     |
[INFO] [stdout] 187 |     fn test_wasm_tokenizer_creation() {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: function `test_wasm_encoding` is never used
[INFO] [stdout]    --> src/lib.rs:192:8
[INFO] [stdout]     |
[INFO] [stdout] 192 |     fn test_wasm_encoding() {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: function `test_wasm_encoding_with_special_tokens` is never used
[INFO] [stdout]    --> src/lib.rs:204:8
[INFO] [stdout]     |
[INFO] [stdout] 204 |     fn test_wasm_encoding_with_special_tokens() {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: function `test_wasm_end_of_word_suffix` is never used
[INFO] [stdout]    --> src/lib.rs:215:8
[INFO] [stdout]     |
[INFO] [stdout] 215 |     fn test_wasm_end_of_word_suffix() {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stdout] warning: function `test_wasm_js_types` is never used
[INFO] [stdout]    --> src/lib.rs:227:8
[INFO] [stdout]     |
[INFO] [stdout] 227 |     fn test_wasm_js_types() {
[INFO] [stdout]     |        ^^^^^^^^^^^^^^^^^^
[INFO] [stdout] 
[INFO] [stdout] 
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 2.63s
[INFO] running `Command { std: "docker" "inspect" "ec15a5579d70fa442d7fb207af92f0540d7a64666ab5ef2e28c6fcc06f50d130", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "ec15a5579d70fa442d7fb207af92f0540d7a64666ab5ef2e28c6fcc06f50d130", kill_on_drop: false }`
[INFO] [stdout] ec15a5579d70fa442d7fb207af92f0540d7a64666ab5ef2e28c6fcc06f50d130
[INFO] running `Command { std: "docker" "create" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/target:/opt/rustwide/target:rw,Z" "-v" "/var/lib/crater-agent-workspace/builds/worker-5-tc1/source:/opt/rustwide/workdir:ro,Z" "-v" "/var/lib/crater-agent-workspace/cargo-home:/opt/rustwide/cargo-home:ro,Z" "-v" "/var/lib/crater-agent-workspace/rustup-home:/opt/rustwide/rustup-home:ro,Z" "-e" "SOURCE_DIR=/opt/rustwide/workdir" "-e" "CARGO_TARGET_DIR=/opt/rustwide/target" "-e" "CARGO_INCREMENTAL=0" "-e" "RUST_BACKTRACE=full" "-e" "RUSTFLAGS=--cap-lints=forbid" "-e" "RUSTDOCFLAGS=--cap-lints=forbid" "-e" "CARGO_HOME=/opt/rustwide/cargo-home" "-e" "RUSTUP_HOME=/opt/rustwide/rustup-home" "-w" "/opt/rustwide/workdir" "-m" "1610612736" "--user" "0:0" "--network" "none" "ghcr.io/rust-lang/crates-build-env/linux@sha256:d429b63d4308055ea97f60fb1d3dfca48854a00942f1bd2ad806beaf015945ec" "/opt/rustwide/cargo-home/bin/cargo" "+1f7f8ea0721a3b1eb73e6c6d25cccb371434b320" "test" "--frozen", kill_on_drop: false }`
[INFO] [stdout] ac4ac841fb10846bfcf04334228a8b6a264cd5dca3a4cd7c06563a1966bc27ba
[INFO] running `Command { std: "docker" "start" "-a" "ac4ac841fb10846bfcf04334228a8b6a264cd5dca3a4cd7c06563a1966bc27ba", kill_on_drop: false }`
[INFO] [stderr] warning: function `create_wasm_test_tokenizer` is never used
[INFO] [stderr]    --> src/lib.rs:159:8
[INFO] [stderr]     |
[INFO] [stderr] 159 |     fn create_wasm_test_tokenizer() -> SDTokenizer {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr]     |
[INFO] [stderr]     = note: `#[warn(dead_code)]` (part of `#[warn(unused)]`) on by default
[INFO] [stderr] 
[INFO] [stderr] warning: function `test_wasm_tokenizer_creation` is never used
[INFO] [stderr]    --> src/lib.rs:187:8
[INFO] [stderr]     |
[INFO] [stderr] 187 |     fn test_wasm_tokenizer_creation() {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: function `test_wasm_encoding` is never used
[INFO] [stderr]    --> src/lib.rs:192:8
[INFO] [stderr]     |
[INFO] [stderr] 192 |     fn test_wasm_encoding() {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: function `test_wasm_encoding_with_special_tokens` is never used
[INFO] [stderr]    --> src/lib.rs:204:8
[INFO] [stderr]     |
[INFO] [stderr] 204 |     fn test_wasm_encoding_with_special_tokens() {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: function `test_wasm_end_of_word_suffix` is never used
[INFO] [stderr]    --> src/lib.rs:215:8
[INFO] [stderr]     |
[INFO] [stderr] 215 |     fn test_wasm_end_of_word_suffix() {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: function `test_wasm_js_types` is never used
[INFO] [stderr]    --> src/lib.rs:227:8
[INFO] [stderr]     |
[INFO] [stderr] 227 |     fn test_wasm_js_types() {
[INFO] [stderr]     |        ^^^^^^^^^^^^^^^^^^
[INFO] [stderr] 
[INFO] [stderr] warning: `sd-tokenizer` (lib test) generated 6 warnings
[INFO] [stderr]     Finished `test` profile [unoptimized + debuginfo] target(s) in 0.12s
[INFO] [stderr]      Running unittests src/lib.rs (/opt/rustwide/target/debug/deps/sd_tokenizer-12ac4ebf2f4815e7)
[INFO] [stdout] 
[INFO] [stdout] running 3 tests
[INFO] [stdout] test tests::test_tokenizer_creation ... ok
[INFO] [stdout] test tests::test_basic_encoding ... ok
[INFO] [stdout] test tests::test_end_of_word_suffix ... ok
[INFO] [stdout] 
[INFO] [stdout] test result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
[INFO] [stdout] 
[INFO] running `Command { std: "docker" "inspect" "ac4ac841fb10846bfcf04334228a8b6a264cd5dca3a4cd7c06563a1966bc27ba", kill_on_drop: false }`
[INFO] running `Command { std: "docker" "rm" "-f" "ac4ac841fb10846bfcf04334228a8b6a264cd5dca3a4cd7c06563a1966bc27ba", kill_on_drop: false }`
[INFO] [stdout] ac4ac841fb10846bfcf04334228a8b6a264cd5dca3a4cd7c06563a1966bc27ba
